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ARMY  SCIENCE  BOARD 
1980  SUMMER  STUDY 
ON 

STATISTICAL  TECHNIQUES  IN  ARMY  TESTING 


I.  INTRODUCTION.  An  Army  Science  Board  (ASB)  Summer  Study  was  conducted 
at  the  Armed  Forces  Staff  College  in  Norfolk,  Virginia,  7-11  July  1980  to 
assess  Statistical  Techniques  in  Testing.  Terms  of  Reference  (TOR)  are 
contained  in  the  16  May  1980  letter  from  the  Assistant  Secretary  of  the 
Army  (Research,  Development  and  Acquisition) ,  attached  at  Appendix  A.  Par¬ 
ticipants  in  the  Summer  Study  are  listed  in  Appendix  B.  The  ASB  parti¬ 
cipants  received  preliminary  briefings  on  5-6  June  1980  in  Washington, 

D.C.  and,  prior  to  the  Summer  Study,  reviewed  test  plans  and  test  results 
that  were  selected  by  the  contributing  members  as  examples  of  both  good 
and  poor  testing  efforts. 

In  order  to  respond  to  the  questions  in  the  TOR,  the  Study  Group  examined 
the  statistical  expertise  available  to  the  Army's  testing  communities.  The 
Study  Group  concluded  that  this  is  an  Important  factor  in  determining  the 
state-of-the-art  of  statistical  techniques  in  testing  and  a  pre-requisite 
to  assessing  the  TOR.  Therefore,  this  report  first  discusses  the  expertise 
in  the  Army  communities.  Next,  responses  are  given  to  the  questions  in 
the  TOR.  Finally,  some  conclusions  and  recommendations  are  offered  for 
improving  the  quality  of  testing  and  evaluation  in  the  Army. 

II.  STATISTICAL  EXPERTISE  IN  THE  ARMY.  The  Study  Group  examined  the  Army's 
statistical  expertise  from  three  aspects:  the  number,  distribution,  and 
quality  control  (management  and  peer  review) . 

The  distribution  of  statistical  personnel  among  the  Army  testing  agencies 
is  shown  in  Table  I.  The  number  of  personnel  in  allied  disciplines  includes 
scientists  with  training  in  mathematics,  engineering,  and  operations  research 
who  are  Involved  at  least  part-time  in  statistical  work.  As  can  be  seen, 
the  commands  involved  in  Operational  Test  and  Evaluation  (OT&E)  and  Devel¬ 
opment  Test  and  Evaluation  (DT&E)  have  about  80  percent  of  all  the  Army 
testing  statisticians.  The  number  of  scientists  in  allied  disciplines 
working  in  statistical  areas  is  more  than  five  times  as  great  as  the  number 
of  pure  statisticians.  The  Study  participants  felt  that  both  the  numbers  and 
the  distribution  of  statistically  trained  personnel  are  adequate,  with  the 
exception  that  some  Product  Assurance  Directorates  (PADs),  proving  grounds, 
and  Boards  have  no  assigned  statisticians.  At  these  levels,  however,  con¬ 
tractor  support  is  reportedly  available  to  provide  some  statistical  expertise. 
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TABLE  1 


ARMY  T&E  STATISTICAL  PERSONNEL 


Statisticians 

Allied 

Disciplines 

Total 

Stat.  Personnel 

OT&E 

15 

126 

141 

DT&E 

50 

233 

283 

PADS 

_16 

98 

114 

Total 

81 

457 

538 

The  Study  Group  was  aot  able  to  review  the  qualifications  of  individual 
Army  Statisticians.  However,  an  attempt  was  made  to  examine  the  standing 
of  the  statistical  community  as  a  whole  by  looking  for  examples  of  outside 
recognition,  e.g.,  fellowships  in  professional  societies,  awards,  and 
publications  in  referred  professional  journals.  It  is  the  judgment  of  the 
Study  Group  overall  quality  of  the  statisticians  is  adequate,  and  in  some 
cases,  excellent. 

In  the  areas  of  education  and  the  dissemination  of  information,  the  Study 
Group  found  that  the  Army  sponsors  a'  wide  variety  of  activities.  Courses 
of  instruction  are  offered  through  universities,  the  Army  Management  Engine¬ 
ering  Training  Activity  (AMETA),  and  the  Army  Logistics  Management  Center 
(ALMC).  In  the  last  three  years,  the  Army  Research  Office  (ARO)  has  spon¬ 
sored  six  workshops  in  mathematical  statistics.  The  Army  Materiel  Systems 
Analysis  Agency  (AMSAA)  and  AMETA  sponsor  training  workshops  in  reliability, 
methodology  and  reliability  growth.  Each  year,  an  Army-wide  conference 
is  conducted  on  experimental  design.  Intern  and  cooperative  student  pro¬ 
grams  are  conducted  at  the  laboratories.  But  even  with  this  wide  variety 
of  excellent  activities,  several  shortcomings  in  statistical  training  were 
cited  to  the  Group.  In  almost  all  these  cases,  a  shortage  of  travel  funds 
or  a  large  workload  prevented  personnel  from  taking  part  in  the  appropriate 
activities. 

The  final  aspect  of  expertise  examined  was  that  of  quality  control.  It 
was  found  that  quality  control  in  terms  of  management  and  of  peer  review 
appears  to  be  adequate  in  general  and,  at  some  of  the  major  centers  of 
statistical  expertise,  is  very  good.  As  will  be  discussed  in  a  later 
section  of  the  report,  there  are  some  levels  at  which  quality  control  may 
not  be  good  enough. 

III.  TERMS  OF  REFERENCE  AND  FINDINGS.  Our  findings  relative  to  each  of 
the  specific  questions  in  the  TOR  are  as  follows: 


IS 


Question  1.  What  araas  of  Army  testing  lead  to  stated,  quantified 
results  (e.g.,  reliability,  safety,  maintainability,  production  accept¬ 
ability/yield)  with  specified  confidence  levels? 

Finding .  The  Study  Group  examined  the  following  testing  areas,  all  of 
which  produced  quantitative  reliability,  maintainability,  and/or  performance 
results: 


o  Research  and  development 
o  Development 
o  Operational 
o  Acceptance 
o  Surveillance 


Question  2.  What  experimental  models  are  currently  applied  to 
such  confidence-level-related  testing?  How  could  more  modern  test  designs 
and  models  maintain  the  same  confidence  levels  while  reducing  test  expenses? 


Findings.  In  its  examination  of  testing,  the  Study  Group  found  many 
techniques  in  common  use  throughout  the  Army  test  communities.  These 
include: 


o  Time  series  analysis 
o  Regression  analysis 
o  Analysis  of  variance 
o  Classical  experimental  design 
o  Nonparametrlc  procedures 
o  Sequential  procedures 
o  Response  surface  methodology 
o  Multivariate  analysis 

Three  other  techniques — the  use  of  interactive  computer  graphics  in  stat¬ 
istics,  exploratory  data  analysis,  and  empirical  Bayes — deserve  more 
attention  in  the  test  communities.  The  Study  Group  considered  that  the 
first,  interactive  computer  graphics,  might  be  highly  valuable. 

As  a  next  step  in  developing  our  taxonomy  of  models,  techniques  were  ident¬ 
ified  that  are  under  development  and  might  be  useful  to  the  Army  (items 
marked  with  an  asterisk  are  considered  to  have  the  most  potential): 

o  Robust  techniques* 
o  Accelerated  testing* 

o  Software  reliability  for  statistical  computer  graphics* 
o  Autoregressive  Integrated  Moving  Average  (ARIMA) 
models: 

-  Multivariate 

-  Intervention  analysis 

o  Analysis  of  variance  of  time  series  models 
o  Pattern  recognition 
o  Computational  statistics 
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Finally,  Che  Group  identified  techniques  requiring  further  basic  research 
for  future  application: 


o  Evaluation  of  software  reliability  for  systems 
o  Multivariate  quantile  response  problem* 
o  ARIMA  models:  Estimation  of  order 

o  Multiple  comparison  procedures  with  general  application 
o  Use  of  prior  information  to  predict  the  effect  of  a 
proposed  modification  on  reliability 
o  Use  of  nondestructive  test  results  to  draw  inferences 
concerning  performance 


Question  3«  To  what  extent  are  state-of-the-art  statistical  techni¬ 
ques  currently  being  applied?  What  might  be  done  to  expand  the  use  of 
such  techniques  in  testing? 


Finding.  As  with  the  Study  Group  assessment  of  statistical  expertise 
available  to  the  Army,  it  was  found  that  the  Army  test  communities  are 
generally  adequate  in  applying  techniques  and,  in  some  areas,  are  leaders 
in  the  field.  For  example,  the  Group  examined  some  tests  and  research 
projects  that  it  considered  to  be  examples  of  outstanding  successes  in 
terms  of  statistical  methodology.  These  included  the  following: 


o  Nonparametric  Estimation  Using  Accelerated  Test  Data 
(ARO) 

o  Sequential  Sampling  Plans: 

-  TOW/Dragon  Gunner  Training  Study  (ARO/USA  Training 
&  Doctrine  Command  CTRADOC)) 

-  Plate  Acceptance  Firings  for  K.E.  Penetrators 
Ballistic  Research  Laboratory  (BRL) 

-  Plan  to  Replace  Chain  Sampling  Plan  for  Rocket  Ac¬ 
ceptance  Tests  (AMSAA) 

o  Multidimensional  Contingency  Table  Analysis  of 

NATO  Small  Arms  Trials  Data  (USA  Operational  Test  & 
Evaluation  Agency  (OTEA) /ARO) 
o  Stochastic  Design  for  Detonation  Propagation  Problem 
(BRL) 

o  Statistical  Test  Design  Plan  for  SLUFAE'  (USA  Test  & 
Evaluation  Command  (TECOM)) 


Testing  methodology  is  not  of  uniform  high  quality,  however.  Although 
an  exhaustive  survey  of  the  areas,  could  not  be  made,  the  Study  Group 
was  concerned  by  test  planning  in  product  acceptance  and  surveillance 
testing.  The  resources  expended  in  these  testing  areas  are  quite  high, 
and  most  of  the  plans  are  designed  at  organizations  (e.g.,  PADs)  at 
which  minimal  statistical  expertise  is  available.  Based  on  a  limited 
examination  of  those  areas,  the  Group  believes  that  a  much  more  detailed 
review  is  needed. 
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There  are  many  constraints  In  real-world  testing  that  limit  the  implemen¬ 
tation  of  techniques,  often  resulting  in  the  use  of  techniques  chat  are 
not  as  sophisticated  as  otherwise  possible  (i.e.,  are  not  up  to  the-state- 
of-the-art).  These  constraints  include  limitations  of  time,  money,  mater¬ 
ial,  people,  and  measurement  techniques. 

Another  area  of  concern  to  the  Study  Group  is  an  apparent  lack  of  early 
coordination  and  interchange  of  information  and  needs  among  the  Project 
Managers,  the  test  designers,  and  the  contractor,  with  a  resulting  impact 
on  the  quality  of  development  and  operational  testing.  The  group  learned 
of  several  incidents  in  which  late  changes  in  the  schedules  and  analysis 
requirements  have  severely  affected  the  quality  of  both  the  testing  and 
analysis.  Some  of  these  incidents  might  have  been  avoided  with  better 
communication.  Finally,  in  the  area  of  communication,  the  Group  was  cold 
of  several  conflicts  in  reported  results  that  may  have  been  due  to  the  use 
of  different  data  sets,  or  to  the  same  data  set  being  used  in  an  attempt 
to  answer  different  questions,  but  which  were  interpreted  as  conflicts  in 
analysis.  More  care  in  explaining  statistical  test  results  to  decision¬ 
makers  is  essential. 

The  final  area  of  concern,  in  terms  of  the  quality  of  testing,  is  the  lack 
of  a  well-documented  audit  trail  throughout  the  development  and  testing 
processes.  First,  quantitative  parameters  in  requirements  documents  are 
stated  without  supporting  rationale.  Then,  test  designs  are  made  and 
presented  without  accompanying  rationale.  Finally,  after  most  equipment  is 
fielded,  there  is  no  effective  collection  of  reliability,  maintainability, 
or  performance  daca  to  help  improve  the  fielded  system,  assist  in  the 
development  of  future  systems  requirements,  develop  better  future  test 
plans  for  similar  systems,  or  to  validate  and  improve  predictive  models. 

IV.  CONCLUSIONS.  The  Army  possesses  enough  sufficiently  qualified  statis¬ 
ticians  to  conduct  the  design  and  analysis  required  by  the  Army  testing 
activities. 

As  a  result  of  the  review  of  the  cases  presented  by  the  Army  testing  agen¬ 
cies,  the  Study  Group  believes  that  the  Army  agencies  are  doing  a  gener¬ 
ally  adequate—and  often  very  good — job  in  their  statistical  activities. 

The  Study  Group  is  very  favorably  impressed  by  the  continuing  efforts  of 
the  Army  statistical  community  to  improve  and  keep  current  with  the  state- 
of-the-art  through  such  vehicles  as  workshops  and  courses. 

V.  RECOMMENDATIONS.  The  following  recommendations  are  intended  to  permit 
the  Army  to  more  fully  exploit  the  capabilities  described  above: 

A.  The  Army  has  several  "Centers  of  Excellence"  in  statistical  tec- 
niques,  tests,  and  analyses  involved  in  testing  (e.g.,  AMSAA,  BEIL,  Combat 
Development  Experimentation  Command  (CDEC),  OTEA,  TECOM).  However,  a 
portion  of  surveillance  testing,  acceptance  testing,  and  DT  and  OT  of 
minor  systems  is  being  conducted  by  the  PADs,  the  Boards,  and  the  Proving 
Grounds.  This  constitutes  tremendous  testing  expenditures.  The  Study 


Group  found  chat  the  statistical  expertise  just  described  is  not  always  avail¬ 
able  to  these  latter  types  of  organizations.  Therefore,  it  is  recommended 
that  the  Army  task  its  Centers  of  Excellence  to  Immediately  structure  a  program 
to  help  upgrade  the  quality  of  these  statistical  activities  by  making  periodic 
visits  and  reviews,  and  by  encouraging  consultations. 

B.  Test  designers  and  analysts  from  the  OT  and  DT  communities  and  the 
contractor  must  be  required  to  meet  at  the  earliest  possible  date  and  period¬ 
ically  thereafter  to  coordinate  their  objectives  and  data  needs.  The  Project 
Managers  must  be  responsible  for  such  coordination. 

C.  The  quantitative  portion  of  the  requirement  documents  must  be  accom¬ 
panied  by  a  rationale  with  supporting  justification.  That  rationale  must  be 
made  available  to  the  appropriate  test  communities. 

D.  The  test  designs  and  plans  for  analysis  developed  by  the  test  organ¬ 
izations  must  also  be  accompanied  by  supporting  rationale.  Among  other  things, 
this  rationale  will  help  reduce  the  confusion  in  Interpreting  test  results 

and  will  indicate  the  risks  implied  by  the  test  plans. 

E.  Schedule  changes  (time  as  well  as  content)  in  development  programs 
that  affect  test  designs  and  analyses  must  Immediately  be  made  known  to  all 
concerned.  This  recommendation  is  intended  to  emphasize  the  importance  the 
Army  places  on  the  testing  component  of  the  development  cycle  and  the  need  to 
provide  sufficient  time  for  analysis. 

F.  Post-Initial  Operational  Capability  (IOC)  field  data  should  be  col¬ 
lected  for  the  purposes  of: 

1.  Making  product  improvements  more  effective. 

2.  Making  future  requirements  more 
meaningful . 

3.  Validating  and  Improving  predictive  models. 

4.  Developing  more  efficient  future  test  plans. 

Obviously,  all  the  Centers  of  Excellence  should  be  involved  in  the  design  of 
such  a  system. 


APPENDIX  A 
TERMS  OF  REFERENCE 

DEPARTMENT  OF  THE  ARMY 
OFFICE  OF  THE  ASSISTANT  SECRETARY 

WASHINGTON,  O.C.  20310 


TO 

ATTENTION  Of 


1  8  MAY  1980 


Dr.  J.  Ernest  Wilkins,  Jr. 
Associate  General  Manager 
EG&G  Idaho,  Incorporated 
Post  Office  Box  1625 
Idaho  Falls,  Idaho  33401 


Dear  Dr.  Wilkins, 

Request  you  select  four  or  five  Army  Science  Board  members 
to  participate  in  a  Summer  Study  to  examine  statistical  con¬ 
cepts  underlying  Army  testing  practices,  with  a  view  toward 
extracting  high  confidence  based  on  generally  fewer  tests. 

If  you  are  free  to  participate,  it  would  appear  appropriate 
to  apply  your  expertise  in  this  work.  It  would  be  appropri¬ 
ate  to  review  current  approaches  with  representatives  of 
TRADOC,  DARCOM,  and  OTEA,  some  of  whom  might  be  asked  to  par¬ 
ticipate  with  the  Study  Group.  Current  state  of  the  art  sta¬ 
tistical  techniques  and  improved  designs  for  testing  should 
be  considered  in  addressing  these  Terms  of  Reference  (TOR) : 

1.  What  areas  of  Army  testing  lead  to  stated,  quantified 
results  (e.g.,  reliability,  safety,  maintainability,  produc¬ 
tion.  acceptability/yield)  with  specified  confidence  levels? 

2.  What  experimental  models  are  currently  applied  to  such 
confidence  level  related  testing?  How  could  more  modern  test 
designs  and  models  maintain  the  same  confidence  levels  while 
reducing  test  expenses? 

3.  To  what  extent  are  state  of  the  art  statistical  techniques 
currently  being  applied?  What  might  be  done  to  expand  the  use 
of  such  techniques  in  testing? 

Preliminary  briefings  should  be  scheduled  over  the  next  few 
weeks.  We  have  arranged  for  this  group  to  meet  7  through  11 
July  1980  at  the  Armed  Forces  Staff  College,  Norfolk,  Virginia 
for  discussion  and  final  report  writing.  A  brief-out  would  be 
scheduled  prior  to  lunch  11  July  to  synopsize  the  findings. 
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I  am  confident  that  this  effort  can  provide  the  Army  with 
guidelines  allowing  continued  high  confidence  in  its  equip¬ 
ment  with  more  economy  in  testing. 

Sincerely, 


(Signed)  £ercy  Eisrre 


Percy  A.  Pierre 

Assistant  Secretary  of  the  Army 
(Research,  Development  and  Acquisition) 


APPENDIX  B 
STUDY  PARTICIPANTS 


Army  Science  Board  Members 

Dr.  Phil  E.  DePoy 

Mr.  Abraham  Golub 

Ms.  Karen  D.  Pettigrew 

Dr.  William  L.  Root 

Dr.  Victor  K.  T.  Tang 

Contributing  Army  Members 

Dr.  Marion  Bryson,  TRADOC 

Dr.  Jagdish  Chandra,  ARO 

Dr.  Larry  Crow,  AMSAA 

Dr.  Robert  Launer,  ARO 

Mr.  Fred  McCoy,  OTEA 

Dr.  David  Miller,  OTEA 

Dr.  Dick  Moore,  BRL 

Dr.  Ted  Trybul,  TECOM 

Mr.  John  Tyler,  ODCSRDA 

Mr.  Lang  Withers,  OTEA 

Dr.  Stephen  Wolff,  BRL 

Dr.  Joseph  H.  Yang, 

Executive  Director,  ASB 

COL  Roger  W.  Mickelson, 
Executive  Secretary,  ASB 

LTC  Dennis  O'Connor,  ODCSRDA, 
Military  Assistant 
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APPENDIX  C 
ACRONYM  DEFINITIONS 


ALMC 

AMETA 

AMSAA 

ARIMA 

ARO 

ASB 

ASA(RDA) 


BRL 

CDEC 

DT 

DT&E 

IOC 

OT 

OT&E 

OTEA 

PAD 

R&D 

TECOM 

TOR 

TRADOC 


Army  Logistics  Management  Center 

Army  Management  Engineering  Training  Activity 

Army  Materiel  Systems  Analysis  Agency 

Auto  Regressive  Integrated  Moving  Average 

Army  Research  Office 

4rmy  Science  Board 

sistant  Secretary  of  the  Army  (Research,  Development  & 
Acquisition) 

Ballistic  Research  Laboratory 

Combat  Development  Experimentation  Command 

Development  Test 

Development  Test  and  Evaluation 

Initial  Operational  Capability 

Operational  Test 

Operational  Test  and  Evaluation 

Operational  Test  and  Evaluation  Agency 

Product  Assurance  Directorate 

Research  and  Development 

Test  and  Evaluation  Command 
Terms  of  Reference 
Training  and  Doctrine  Command 
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Office  Secretary  of  the  Army 
The  Pentagon 
Washington,  D.C.  20310 

Office  Chief  of  Staff  of  the  Army 
The  Pentagon 
Washington,  D.C.  20310 

Office  Under  Secretary  of  the  Army 
The  Pentagon 
Washington,  D.C.  20310 

Office  Vice  Chief  of  Staff  of  the  Army 
The  Pentagon 
Washington,  D.C.  20310 


Commander 

US  Army  Materiel  Development 
and  Readiness  Command 
5001  Eisenhower  Avenue 
Alexandria,  Virginia  22333 

Commander 

US  Army  Training  and  Doctrine  Command 
Fort  Monroe,  Virginia  23651 

Commander 

US  Army  Forces  Command 

Fort  McPherson,  Georgia  30330 

Commander 

Operational  Test  and  Evaluation  Agency 

5600  Columbia  Pike 

Falls  Church,  Virginia  22041 

Deputy  Commander,  Materiel  Readiness 
US  Army  Miateriel  Development 
and  Readiness  Command 
5001  Eisenhower  Avenue 
Alexandria,  Virginia  22333 

Deputy  Commander 

US  Army  Training  and  Doctrine  Command 
Fort  Leavenworth,  Kansas  23651 
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Deputy  Commander 
US  Army  Forces  Command 
Fort  McPherson,  Georgia 


COPIES 


30330 


Deputy  Under  Secretary  of  the  Army 
for  Operations  Research 
The  Pentagon 
Washington,  D.C.  20310 

Director  Requirements 
Office  Deputy  Chief  of  Staff 
for  Operations  and  Plans 
The  Pentagon 
Washington,  D.C.  20310 


Office  Deputy  Chief  of  Staff 
for  Operations  and  Plans 
The  Pentagon 
Washington,  D.C.  20310 

Office  Deputy  Chief  of  Staff 

for  Research,  Development  and  Acquisition 
The  Pentagon 
Washington,  D.C.  20310 

Office  Deputy  Chief  of  Staff 
for  Logistics 
The  Pentagon 
Washington,  D.C.  20310 

Office  Deputy  Chief  of  Staff 
for  Personnel 
The  Pentagon 
Washington,  D.C.  20310 

Office  Assistant  Chief  of  Staff 
for  Intelligence 
The  Pentagon 
Washington,  D.C.  20310 

Office  Assistant  Chief  of  Staff 
for  Automation  and  Communication 
The  Pentagon 
Washington,  D.C.  20310 


nrsT-? 


DISTRIBUTION  CONT.: 

ADDRESSEE 


Commander 

Army  Logistics  Management  Center 
Fort  Lee 

Petersburg,  Virginia  23801 
Commander 

Test  and  Evaluation  Command 

Aberdeen  Proving  Ground,  Maryland  2 1005 

Director,  Ballistic  Research  Lab 
Aberdeen  Proving  Ground,  Maryland  21005 

Director,  US  Army  Materiel  Systems 
Analysis  Activity 

Aberdeen  Proving  Ground,  Maryland  21005 
Commander 

Army  Research  Office 
P.0.  Box  12211 

Research  Triangle  Parle,  NC  27709 
Commander 

Combat  Development  Experimentation  Command 
Fort  Ord,  California  93941 

Director,  Defense  Test  and  Evaluation 
Office  Secretary  of  Defense 
The  Pentagon 
Washington,  D.C.  20301 


Department  of  the  Army 

Committee  Management  Office  (SAAA-SS) 

(for  Library  of  Congress) 

Washington,  D.C.  20310 


Defense  Documentation  Center 
Defense  Supply  Agency 
ATTN:  DDC-TC 
Cameron  Station 
Alexandria,  Virginia  22314 
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Army  Science  Board 

Office  Assistant  Secretary  of  the  Army 
Research,  Development,  and  Acquisition 
Washington,  D.C.  20310 

Defense  Science  Board 
Office  Under  Secretary  of  Defense, 
Research  and  Engineering 
Washington,  D.C.  20301 

Air  Force  Scientific  Advisory  Board 
Headquarters  US  Air  Force 
Washington,  D.C.  20330 

Naval  Research  Advisory  Committee 
Office  of  the  Secretary 
Washington,  D.C.  20350 


Dr.  Phil  E.  DePoy 
Director,  Operations 
Evaluation  Group 
Center  for  Naval  Analyses 
2000  North  Beauregard  Street 
Post  Office  Box  11280 
Alexandria,  VA  22311 

Mr.  Abraham  Golub 
President,  Abraham  Golub,  Inc. 
Watergate  at  Landmark,  Suite  607 
203  Yoakum  Parkway 
Alexandria,  VA  22304 

Ms.  Karen  D.  Pettigrew 
Research  Mathematical  Statistician 
National  Institutes  of  Health 
Building  36,  Room  ID- 19 
Bethesda,  MD  20205 
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Dr.  William  L.  Root 
Professor,  College  of 
Engineering 

Departmenc  of  Aerospace 
Engineering 

University  of  Michigan 
Ann  Arbor,  MI  48109 
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